Self-tuned critical anti-Hebbian networks.
نویسندگان
چکیده
It is widely recognized that balancing excitation and inhibition is important in the nervous system. When such a balance is sought by global strategies, few modes remain poised close to instability, and all other modes are strongly stable. Here we present a simple abstract model in which this balance is sought locally by units following "anti-Hebbian" evolution: all degrees of freedom achieve a close balance of excitation and inhibition and become "critical" in the dynamical sense. At long time scales, a complex "breakout" dynamics ensues in which different modes of the system oscillate between prominence and extinction; the model develops various long-tailed statistical behaviors and may become self-organized critical.
منابع مشابه
Why Do Similarity Matching Objectives Lead to Hebbian/Anti-Hebbian Networks?
Modeling self-organization of neural networks for unsupervised learning using Hebbian and anti-Hebbian plasticity has a long history in neuroscience. Yet derivations of single-layer networks with such local learning rules from principled optimization objectives became possible only recently, with the introduction of similarity matching objectives. What explains the success of similarity matchin...
متن کاملCritical dynamics in associative memory networks
Critical behavior in neural networks is characterized by scale-free avalanche size distributions and can be explained by self-regulatory mechanisms. Theoretical and experimental evidence indicates that information storage capacity reaches its maximum in the critical regime. We study the effect of structural connectivity formed by Hebbian learning on the criticality of network dynamics. The netw...
متن کاملRobustness of Hebbian and Anti{hebbian Learning
Self{organizing neural networks with Hebbian and anti{Hebbian learning rules were found robust against variations in the parameters of neurons of the network, such as neural activities, learning rates and noisy inputs. Robustness was evaluated from the point of view of properties of soft competition for input correlations. Two models were studied: a neural network with presynaptic Hebbian learn...
متن کاملA Network Which Performs Orthonormalized Principal Subspace Extraction
We propose a linear neural network which nds the subspace spanned by the principal components of its inputs, and scales the outputs so that they are uncorrelated with equal variance. We suggest that, to a rst approximation, this orthonormalized principal subspace extraction will give improved transmission of information over other PCA networks in the presence of output noise. The network employ...
متن کاملSelf-organization of Hebbian Synapses in Hippocampal Neurons
We are exploring the significance of biological complexity for neuronal computation. Here we demonstrate that Hebbian synapses in realistically-modeled hippocampal pyramidal cells may give rise to two novel forms of self -organization in response to structured synaptic input. First, on the basis of the electrotonic relationships between synaptic contacts, a cell may become tuned to a small subs...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Physical review letters
دوره 102 25 شماره
صفحات -
تاریخ انتشار 2009